Achievement Rates App

This report applies only to English contracts.

Certain programme aims are excluded from the Apprenticeship Achievement Rates. The exclusion rules are applied based on the QAR ruleset that you run the report with (this can be chosen in the parameters):

Parameters

Layout

The report is split into five sections:

Summary of Success

The Summary of Success shows an overview of overall and timely Achievement Rates for the current contract year and the three previous years. The data is grouped by two levels of Apprenticeship achievement:

The data for each grouping shows the Achievement Rate percentage, the number of learners who were successful (left number) and the overall number of learners (right number). Clicking on either number will show the relevant learners.

Success Rate Trends

The Success Rate Trends graph shows the percentages from the Summary of Success table.

Cohort Identification (Apprenticeship only)

The Cohort Identification table shows the number of learners who ended learning, comparing their planned end year to their actual end year. A separate table shows the overall and timely cohorts, and the number of learners who transferred to other providers.

The timely cohort for a year is calculated as the total number of learners planned to end that year (i.e. the horizontal sum of completions). The overall cohort is calculated as the timely cohort, minus any continuing learners for the year (i.e. any red figures for the planned end year), plus any late achievers for the year (i.e. any red figures for the actual end year). A quick way of calculating this is to find the green box for the planned end year and add any white figures to the left of it and any red figures above it.

Framework Achievements (Apprenticeship only)

The timely and overall calculation methodologies for the Framework Achievements table are the same as on the Cohort Identification table. However, this table shows the number of learners who achieved their framework, comparing their planned end year to their actual end year.

Framework or NVQ Achievements (Apprenticeship only)

The timely and overall calculation methodologies for the Framework or NVQ Achievements table are the same as on the other two tables. However, this table shows the number of learners who achieved either their framework or NVQ, comparing their planned end year to their actual end year.

Clicking on a figure on any of the tables, or a column on the graph, will show a drill-down list for all the relevant learners.

Explanation of Timely and Overall Cohorts

Achievement Rates are measured in overall and timely cohorts, which are defined by the SFA. A cohort is simply a group of learners during a period of time. The Maytas Achievement Rate reports distinguish between cohort years (based on contract years) and cohort months. For example, a learner with a timely cohort month of August 2015 would have a timely cohort year of 2015/16.

Timely Cohort

A learner's timely cohort is determined by the month/year in which their planned end date falls. For example, if a learner had a planned end date of 01/09/2015, their timely cohort month would be September 2015 and their timely cohort year would be 2015/16.

To be a timely achiever, a learner must achieve their main aim or framework within 90 days of their planned end date (or before the planned end date). This requires a programme aim completion status of 2 (completed) and a programme aim outcome of 1 (achieved), and the actual end date must be no more than 90 days after the planned end date. The Maytas Achievement Rate reports distinguish between timely framework achievers and timely NVQ (i.e. main aim) achievers. If a learner is a timely achiever, their timely achiever cohort year and month is the same as their timely cohort.

It is important to note that the 90 day rule only applies when determining timely achievers, not the timely cohort. i.e. If a learner leaves more than 90 days after their planned end date, they would not be counted as a timely achiever but they would still be counted in the timely cohort.

The timely cohort can include live learners as well as leavers.

Overall Cohort

A learner's overall cohort is determined by the month/year in which the most recent of the planned end date and the actual end date falls. In other words, if the planned end date is after the actual end date, the planned end date is used, otherwise the actual end date is used.

It is important to note that the overall cohort only includes leavers (i.e. learners with an actual end date), unlike the timely cohort.

To be an overall achiever, a learner must achieve their main aim or framework. This requires a programme aim completion status of 2 (completed) and a programme aim outcome of 1 (achieved). Unlike the timely cohort, it does not matter when the achievement takes place. The Maytas Achievement Rate reports distinguish between overall framework achievers and overall NVQ (i.e. main aim) achievers. If a learner is an overall achiever, their overall achiever cohort year and month is the same as their overall cohort.

Achievement Rates Reconciling vs Anticipated Results

We have received queries and feedback from providers around how the achievement rates data is produced and what that data represents. Since the major QAR rule changes were introduced in January 2017, our intention has been to produce what we expect the latest published QAR results to be. This means that in some cases, data which was exported in recent contract years has been ignored in favour of earlier data, as the earlier data is what we expect the ESFA to be using to produce the latest QARs.

While this is the most accurate way to reconcile against current published figures, it is not useful for showing future expected results based on current data. To address this, the reports allow you to toggle between these two options with the Reconcile or predict parameter: